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Abstract 


As  the  Alzheimer’s  disease  field  moves  to  studies  and  intervention  trials  in  the  preelinieal  phase  and  early 
prodromal  period,  it  will  be  necessary  to  measure  everyday  fimction  in  an  increasingly  more  sensitive  and 
sophisticated  way  to  capture  more  subtle  impairments.  One  approach  to  increasing  sensitivity  in  functional 
measures  is  to  use  performance  based  instruments,  such  as  the  UCSD  Performance-based  Skills  Assessment 
(UPSA),  in  Mild  Cognitive  Impairment  (MCI)  or  mild  Alzheimer’s  disease  (AD)  research.  In  this  test  patients 
are  observed  and  their  response  scored  as  they  actually  perform  proxies  for  real  world  tasks  and  it  contrasts  with 
more  typical  informant  based  measures.  In  a  preliminary  study  we  compared  patients  with  MCI,  patients  with 
mild  AD  who  by  diagnosis  have  functional  impairments,  and  healthy  age  matched  controls  on  the  UPSA,  as 
well  as  measures  of  cognition  (e.g.,  episodic  memory,  semantic  memory,  executive  function,  speed).  We  found 
that  patients  with  MCI  had  compromises  in  everyday  functional  competence  and  that  the  UPSA  was  strikingly 
sensitive  to  these  (Goldberg  et  al,  2010).  Additionally  the  UPSA  outperformed  an  informant  based  measure  on 
a  variety  of  criteria.  However,  that  study  was  not  longitudinal.  Therefore,  it  is  important  that  we  obtain  data  on 
the  longitudinal  characteristics  of  the  UPSA  in  these  populations,  including  the  severity  of  decline  in  this 
measure  over  time,  the  relationship  of  decline  to  cognitive  changes  in  order  to  determine  the  validity  of  the 
UPSA,  and  its  technical  psychometric  characteristics  (e.g.,  test-retest  reliability). 

In  the  present  longitudinal  study  we  found  large  between  group  differences  on  the  UPSA,  such  that  HCs 
outperformed  MCI  individuals,  who  in  turn  outperformed  AD  individuals.  We  did  not  find  a  significant  effect 
of  time  nor  a  group  by  time  interaction.  Psychometrically  the  UPSA  showed  very  good  test-retest  reliability. 
Additionally,  correlations  between  the  long  form  and  short  form  were  very  high.  However,  a  practice  effect  was 
noted  at  six  weeks. 


Introduction 

As  the  Alzheimer’s  disease  field  moves  to  studies  and  intervention  trials,  it  will  be  necessary  to  measure 
everyday  function  in  an  increasingly  more  sensitive  and  sophisticated  way  to  capture  more  subtle  impairments. 
One  approach  to  increasing  sensitivity  in  functional  measures  is  to  use  performance  based  instruments,  such  as 
the  UCSD  Performance-based  Skills  Assessment  (UPSA),  in  Mild  Cognitive  Impairment  (MCI)  or  mild 
Alzheimer’s  disease  (AD)  research.  In  this  test  patients  are  observed  and  their  response  scored  as  they  actually 
perform  proxies  for  real  world  tasks  (such  as  determining  which  bus  route  to  take,  writing  a  check,  planning  a 
trip  to  the  beach,  and  recalling  an  appointment’s  time  and  place).  In  a  preliminary  study  we  compared  patients 
with  MCI,  patients  with  mild  AD  who  by  diagnosis  have  functional  impairments,  and  healthy  age  matched 
controls  on  the  UPSA,  as  well  as  measures  of  cognition  (e.g.,  episodic  memory,  semantic  memory,  executive 
function,  speed).  We  found  that  patients  with  MCI  had  compromises  in  everyday  functional  competence  and 
that  the  UPSA  was  strikingly  sensitive  to  these  (Goldberg  et  al,  2010).  However,  that  study  was  not 
longitudinal.  Since  our  intial  review  several  new  measures  of  everyday  function  have  been  introduced. 

However,  these  are  informant  based  and  may  be  subject  to  informant  biases,  lack  of  knowledge,  or  imprecision. 

Therefore,  it  is  important  that  we  obtain  data  on  the  longitudinal  characteristics  of  the  UPSA  in  these 
populations,  including  the  severity  of  decline  in  this  measure  over  time,  the  relationship  of  decline  to  cognitive 
changes  in  order  to  determine  the  validity  of  the  UPSA,  and  its  technical  psychometric  characteristics  (e.g.,  test- 
retest  reliability).  We  will  longitudinally  assess  magnitude  of  decline  in  the  UPSA  individuals  with  MCI  and 
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mild  AD  assessed  at  baseline,  6  weeks,  and  12  months.  We  will  compare  and  contrast  decline  in  the  UPSA  with 
a  commonly  used  measure  of  function  administered  to  informants  (the  FAQ)  in  MCI  and  AD  using  Effect  Sizes 
(ES)  and  mixed  model  repeated  measures.  We  will  determine  the  cognitive  measures  that  best  predict  decline  in 
the  UPSA.  We  predict  that  the  UPSA  will  decline  over  time  in  the  MCI  and  AD  groups  with  and  demonstrate 
strong  relationships  to  cognitive  decline 


Key  Research  Accomplishments 

•  Recruitment  of  subjects  for  baseline  evaluation  and  longitudinal  follow  up.  To  date  over  60  subjects 
have  been  enrolled  and  data  were  analyzed  in  this  report  (see  below).  A  total  of  147  assessments  were 
completed. 

•  Implementation  of  testing  procedures  and  screening  procedures.  Entry  of  data  into  our  database. 

•  We  answered  key  scientific  questions  listed  in  our  Aims.  In  particular  we  found  that  psychometric 
properties  of  the  UPSA  were  robust;  that  the  UPSA  was  sensitive  to  diagnostic  class  such  that  HCs 
>MCI>AD  in  terms  of  UPSA  performance;  that  in  this  cohort  in  which  cognitive  level  was  relatively 
stable  over  the  one  year  period  of  follow  up,  UPSA  performance  was  also  stable;  and  that  UPSA  short 
form  and  long  form  were  highly  correlated.  We  also  noted  a  practice  effect  for  the  UPSA  at  six  weeks. 


Methods 

Subjects 

Recruitment  began  September  21,  2012  with  North  Shore-LIJ  IRB  and  ORP  approval.  Eor  the  analyses 
presented  here,  36  healthy  controls  (HCs),  10  individuals  with  Mild  Cognitive  Impairment  (MCI),  and  14 
individuals  with  Alzheimer’s  disease  (AD)  were  included  at  baseline.  Retention  rates  for  these  subjects  over  the 
course  of  this  one  year  longitudinal  study  (with  three  assessments)  was  high  at  >63%.  Nevertheless,  as  these 
sample  sizes  are  below  are  recruiting  goals.  In  order  to  rectify  this  we  have  requested  a  No  Cost  Extension  (see 
Appendix). 

Demographic  data  are  in  Table  1.  Mean  ages  of  the  groups  were  in  the  72  to  74  year  range.  Sex  ratio  was  more 
or  less  equivalent  across  groups.  The  groups  were  well-educated  with  approximately  16  years  of  education. 


Results  and  Discussion 

Test  retest  reliability  (over  a  six  week  period)  was  high  in  the  sample  at  r>.84  for  both  forms  (ps<.0001). 

One  of  our  key  analyses  consisted  of  a  mixed  model  repeated  measures  ANOVA  on  the  UPSA  scores. 
Diagnostic  group  was  a  main  effect,  time  (baseline,  6  weeks,  one  year)  was  a  within  subjects  effect,  and 
diagnosis*time  was  the  interaction  term.  Results  were  as  follows  (see  Tables  3,4). 

1 .  A  main  effect  of  diagnostic  group  was  present:  HCs>MCI>AD. 

2.  No  effect  of  time  was  present. 

3.  No  diagnosis*time  interaction  was  present. 
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These  results  suggest  two  possibilities.  First,  it  is  possible  that  the  UPSA,  while  sensitive  to  group  differences 
among  HC,  MCI,  and  AD  groups,  may  be  relatively  insensitive  to  within  subject  change.  The  second  possibility 
is  that  cohort  effects  were  in  play,  such  that  groups  expected  to  show  decline  were  instead  relatively  stable  over 
a  12  month  period.  We  thus  explored  these  possibilities  by  examining  a  second  measure  known  to  show  decline 
in  MCI  and  AD  groups — the  Mini  Mental  State.  If  this  measure  did  not  show  change,  then  we  can  infer  that  our 
UPSA  finding  was  not  a  measurement  characteristic,  but  rather  it  was  a  cohort  effect.  Indeed,  when  we 
subjected  our  Mini  Mental  to  a  mixed  model  repeated  measure,  we  found  large  group  differences  (p<.0001),  but 
no  time  effect  (p>.50).  This  result  suggests  that  the  MCI  and  AD  groups  were  rather  stable  (though  it  is 
important  to  note  that  both  groups  declined  and  declined  more  than  the  HC  group,  albeit  non-significantly).  It  is 
generally  appreciated  that  many  patients  with  MCI  and  even  AD  can  display  relative  cognitive  stability  for 
periods  of  one  to  two  years. 

The  correlation  between  the  long  form  and  short  form  of  the  UPSA  was  .94  (p<.0001).  Given  the  high 
correlation  between  the  two  forms  of  the  test  and  their  high  test-retest  reliabilities,  we  suggest  that  the  short 
form  will  be  utilized  more  frequently  for  pragmatic  reasons  (because  it  takes  less  time  to  administer). 

Over  six  weeks  the  practice  effect  in  Cohens  d  effect  size  units  was  .33  in  the  HC  group  (medium),  .56  in  the 
MCI  group  (medium),  and  .12  in  the  AD  group  (small).  These  results  were  somewhat  unexpected  but  others 
have  observed  rather  large  practice  effects  in  MCI  and  AD  samples  (Duff  et  al;  Goldberg  et  al  2015).  Over  one 
year  the  practice  effects  in  Cohens  d  effect  size  units  were  all  small  (i.e.  <0)  in  the  HC  group,  in  the  MCI 
group,  and  in  the  AD  group. 

The  results  are  shown  in  Figures  1  and  2.  A  practice  effect  can  be  seen  at  6  weeks  for  the  HC  and  MCI  groups. 
Additionally  decline  from  the  6  week  timepoint  was  most  evident  in  the  MCI  and  AD  groups. 


References 

Goldberg  TE,  Koppel  J,  Keehlisen  L,  Christen  E,  Werringloer  U,  Conejero -Goldberg  C,  Gordon  ME,  Davies  P. 
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Impairment  and  Alzheimer’s  disease.  Am  J  Geriatric  Psychiatry.  2011  Nov;19(l  l):915-22 
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Table  1  Group  Demographics 


Group 

Age 

Gender 

Education 

n(baseline) 

n(6  week  s) 

n{l  year) 

Healthy 

Control 

71.5 

(12.03) 

53%  male 

16.61  (2.57) 

36 

31 

26 

Mild  Cognitive 
Impairment 

72.8 

(10.16) 

50%  male 

17.2  (2.25) 

10 

9 

5 

Alzheimer's 

Disease 

74(10.05) 

50%  male 

15.5  (3.37) 

14 

8 

8 
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Table  2.  Descriptive  data  for  the  UPS  A  long  and  short  forms 


Diagnosis=HC 


Variable 

Mean 

Std  Dev 

Minimum 

Maximum 

N 

MMSE BL 

28.9166667 

1.5189282 

23.0000000 

30.0000000 

36 

UPSA-SHORT 1 

88.3230453 

6.1787890 

74.0740741 

100.0000000 

36 

UPSA  LONGJ 

89.7802095 

6.7589245 

73.4680135 

100.0000000 

36 

MMSE 6WK 

28.3548387 

1 .7425726 

22.0000000 

30.0000000 

31 

UPSA  SHORT 2 

90.3823178 

7.0988087 

75.9259259 

100.0000000 

31 

UPSA  LONG 2 

92.5811882 

5.0450183 

81.7508418 

100.0000000 

31 

MMSEJYR 

28.6923077 

1 .5432234 

24.0000000 

30.0000000 

26 

UPSA  SHORT 3 

87.6153846 

8.0147195 

68.5185185 

98.1481481 

26 

UPSA  LONG 3 

90.9790210 

6.9215856 

72.4915825 

99.0740741 

26 1 

Diagnosis=MCI 


Variable 

Mean 

Std  Dev 

Minimum 

Maximum 

N 

MMSE BL 

27.0000000 

2.3570226 

21.0000000 

30.0000000 

10 

UPSA-SHORT 1 

77.0370370 

9.1641203 

64.8148148 

90.7407407 

10 

UPSA  LONGJ 

84.2912458 

5.7579939 

72.8619529 

90.8249158 

10 

MMSE 6WK 

26.3333333 

2.0615528 

24.0000000 

29.0000000 

9 

UPSA  SHORT 2 

80.8641975 

10.7183675 

62.9629630 

96.2962963 

9 

UPSA  LONGJ 

86.5937149 

8.7528287 

71 .9360269 

95.8754209 

9 

MMSEJYR 

26.2000000 

1.6431677 

25.0000000 

28.0000000 

5 

UPSA  SHORT 3 

75.1851852 

8.7449770 

64.8148148 

83.3333333 

5 

UPSA  LONGJ 

83.9562290 

6.1380319 

75.5892256 

91.6666667 

5 

Diagnosis=AD 


Variable 

Mean 

Std  Dev 

Minimum 

Maximum 

N 

MMSE BL 

20.3571429 

5.2857885 

11.0000000 

28.0000000 

14 

UPSA-SHORTJ 

55.0264550 

21.6501455 

12.9629630 

83.3333333 

14 

UPSA  LONGJ 

53.8768639 

29.8509381 

6.4814815 

91.6666667 

14 

MMSEJWK 

20.5000000 

4.7809144 

14.0000000 

28.0000000 

8 

UPSA  SHORTJ 

55.3240741 

23.0965032 

18.5185185 

74.0740741 

8 

UPSA  LONGJ 

59.0256734 

30.9748460 

9.2592593 

83.8383838 

8 

MMSEJYR 

20.2500000 

5.7008771 

8.0000000 

25.0000000 

8 

UPSA  SHORTJ 

47.2222222 

21.2300557 

3.7037037 

74.0740741 

8 

UPSA  LONGJ 

51 .3383838 

27.7088757 

1.8518519 

84.7643098 

8 
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Table  3.  Mixed  Model  Analyses  for  UPS  A  Short  and  Long  Forms 


Type  3  Tests  of  Fixed  Effeets  for  UPSA  Short 


Effeet 

Num  DF 

Den  DF 

F  Value 

Pr  >  F 

Diagnosis 

2 

138 

100.51 

<.0001 

Time 

2 

138 

1.55 

0.2165 

Diagnosis*Time 

4 

138 

0.39 

0.8186 

Type  3  Tests  of  Fixed  Effeets  for  UPSA  Eong 


Effeet 

Num  DF 

Den  DF 

F  Value 

Pr  >  F 

Diagnosis 

2 

138 

69.37 

<.0001 

Time 

2 

138 

0.73 

0.4816 

Diagnosis*Time 

4 

138 

0.15 

0.9636 
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Figure  1.  Performance  of  the  three  groups  over  time  on  the  UPSA  long  form 
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Figure  2.  Performance  of  the  three  groups  over  time  on  the  UPSA  short  form 
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Appendix  I 


The  Feinstein  Institute 

for  Medical  Research  sSlIx-  L  If 

The  Litwin-Zucker  Research  Center 
for  the  Study  of  Alzheimer's  Disease 

iSO  Community  Drivt,  tth  Poor 
ManTiaort  How  fortt  1 1030 

waw  scz-jav 

roM  (SIS)  5U-0401  March  fO,  201b 

The  Feinstein  Institute  (or  Medical  Research 
Ms.  Rita  Nigri 

Office  of  Grants  and  Contracts 
3b0  ConwTKjnity  Drive 
Manhasset,  NY  11030 
(S16)  562-3106 

Project  Officer,  Cheryll  Q^iirln 

Telemedicine  and  Advanced  Techrxilogy  Research  Center  (TATRC) 

US  Army  AAedical  Research  and  AAateriel  Command  (USAMRMC) 

Fort  Oetrlck,  MD  21702 

Dear  Ms.  Qutrin, 

I  am  writing  to  request  a  no  cost  extension  (NCCJ  for  a  period  of  12  months  under  Award  No. 
W81XWH-12-1-0084  through  April  15,  2016  for  the  proj^t  entitled  "Longitudinal  Study  of  a 
ftovel.  Performance-based  Measure  of  Everyday  Functional  Competence"  The  award  is 
currently  scheduled  to  end  on  15,  2015. 

The  progress  on  this  project  was  delayed  because  of  slo¥yed  recruiting  for  this  ambiPous 
study.  While  we  have  recruited  nearly  70  subjects  with  excellent  retention  across  the  one 
year  longitudinal  study  period  (incorpcKating  3  assessments,  for  a  total  of  nearly  200 
assessments)  we  appreciate  the  need  for  more  subjects  to  test  our  hypotheses  fully.  We  will 
continue  to  seek  ORP  and  IRB  approval  for  this  ong^ng  study. 

The  current  award  is  fully  spent,  and  we  will  use  internal  furvis  to  support  the  study  during 
the  exteraion.  Including  the  post-doctoral  fellow,  study  coordinatorfrecruiler, 
psychometrician,  physician,  and  Principal  Investigator  time  and  effort  during  this  period. 


Also  enclosed  please  find  an  updated  SOW  and  revised  timeline.  Thank  you  for  your 
understanding  and  assistance. 


Enc. 

Cc;  Or,  Anthony  Pacifico 
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